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GAME SYSTEM AND j Mfrqft ffffyqgwaVTWfs ^PTurp 

TECHNICAL FIELD 

The present invention relates to a game system,, program 
5 and image generating method. 

BACKGROUND ART 

In the prior Art, there is known an image generating 
system which can generate an image viewable from a given 
10 viewpoint in an object space that is a virtual three-dimensional 
space. Such an image generating system is very popular as a 



^3 system which can realize a so-called virtual reality* If the 

%\ image generating system is for a racing game, a player can enjoy 



a three-dimensional game by controlling and running a racing 



VJ 15 car (or object) in the object space to compete with, the other 



^ racing cars controlled by the other players or computer. 

However, an image generated by the prior art image 
U1 generating system will not be focused depending on the distance 

from a viewpoint as in the actual human view. Thus, the 
20 representation is such that all the subjects within the image 
are in focus. 

The image in which all the subjects ranging between the 
shouting distance and the long distance are in focus is abnormal 
in our daily life. 
25 To pursue the reality, it is desirable that an image is 

generated in which a focus is regulated depending on the 
distance between the viewpoint and an object or the direction 
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of sight line. However, the processing load will be increased 
if a defocused image is generated by calculating the distance 
between an individual object and the viewpoint within a game 
space to process the degree of defocusing for each object. 

In an image generating system which must generate an image 
corresponding to a real-time variable viewpoint using its 
limited hardware resource, it is important that such an image 
as focused or defocused in the actual world can be generated 
using less processing load. 



XO 

a 

In view of the aforementioned problem, an objective of 

W 

\j the present invention is to provide a game system and 

U! 

or- 

fll 15 image with less processing load. 



DISCI/OSTmE OF THE INVENTION 



information storage medium which can generate a more realistic 



kfc Another objective of the present invention is to provide 



a game system and information storage medium which can generate 



UT a realistic image using an alpha < as) value set depending on a 

C3 

depth value with less processing load. 

20 Still another objective of the present invention is to 

provide a game system and information storage medium which can 
generate such an image as focused or defocused in the actual 
world with less processing load. 

To accomplish these objectives, the present invention 

25 provides a game system which generates an image, comprising: 
means which transforms a depth value of each pixel of an original 
image into a second depth value formed of lower bite I to J which 
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* are positioned lower than the most significant bit of the depth 
value; means which sets an alpha value of each pixel to a value 
corresponding to the second depth value; and means which 
generates an image based on the set alpha value. The present 
5 invention also provides a computer -usable information storage 
medium comprising a program for a computer to realize the 
above -described means. The present invention further provides 
a computer-usable program (including a program embodied in a 
carrier wave) comprising a processing routine for a computer 
.10 to realize the above -described means. 

According to the present invention, the depth value for 

M3 each pixel in the original image is transformed into the second 

W 

depth value consisting of the bits 1 to J in tne firs t -mentioned 
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depth value. Next, an alpha value for each pixel is set at a 



enables various image representations (such as depth of f ield r 
f f ects or depth cueing) . 

According to the present invention, the alpha value for 



fy 15 value depending to the second depth value, the set alpha value 

3 

t^i, being used to generate an image. Application of the alpha value 

b 

y*j fog effects or depth cueing) . 

20 each pixel is set at a level depending on the second depth value 
formed of lower bits I to J than the most significant bit in 
the depth value. Therefore f the effective number of partitions 
in the alpha value (or the effective number of threshold steps 
in the depth value) can be increased in comparison with a 

25 technique of setting a train of higher bits including the most 
significant bit in the depth value as a second depth value. As 
a result, the alpha value can be controlled with improved 
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accuracy, using multi -stepped thresholds. This improves images 
to toe generated in quality. 

The alpha value is information stored associated with 
eacfc. pixel, such as information other than color information. 
Techniques of setting the alpha value at a level depending on 
the second depth value include a method of using a lookup table 
for index color texture mapping, or a method of updating an alpha 
value of a deeper or closer pixel from a virtual object by drawing 
virtual objects in a sequential manner, for example* 

In the game system, information storage medium or program 
of the present invention , the original image may be blended with 
a def ocused image of the original image based on the alpha value 
Bet for each pixel. 

In this configuration, a depth value for each pixel in 
the original image is transformed into a second depth value 
formed of bits I to J in the depth value. An alpha value for 
each pixel is then set depending on the second depth value, and 
the set alpha value is then used to blend the original image 
with its def ocused image. Therefore, the blending ratio or other 
factors of the defocused image can be changed depending on the 
depth value (or the second depth value) , enabling 
representation of the depth of field or the like. 

According to the present invention* since the effective 
number of partitions for the alpha value can be increased, the 
degree of defocusing in an object located near the focus (or 
a gazing point) of a virtual camera can more accurately be 
controlled by using multi - stepped threshold values to improve 
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* the? <juality of generated images. 

The technique of blending the original image with its 
defocused image may be any of various known techniques. The 
process of blending the images using the alpha value is not 
5 limited to the alpha (a) blending in narrow sense. 

The representation of image using the alpha value 
according to the technique of the present invention is not 
limited to a representation of depth of filed. 

Alpha blending on the color of the original image and a 
10 given color based on the alpha values set according to the 
present invention enables fog effects in which the color of the 



original image approaches to the given color as an object of 
the original image becomes further from (or closer to) the 

ui • 

01 



viewpoint . 



PJ 15 The brightness or chroma of the original image may be 



LjS, changed based on the set alpha values. 

rn 

7* Moreover, alpha blending may be performed on the original 

UI ima«re and a given other image based on the set alpha values. 

o 

!^ Alternatively, based on the set alpha values, alpha 

20 blending may be performed on the original image and its 
transformed image (on which gamma correction, 
negative/positive inversion, posterization, solari2ation, 
binarization, monotone filtering, sepia filtering or the like 
is performed) . 

25 In the game system, information storage medium or program 

of the present invention, the defocused image of the original 
image may be generated by setting the original image as a texture 
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and shifting texture coordinates of a virtual object when the 
texture is mapped onto the virtual object by texel interpolation 
method. 

In this configuration, a simplified process in which an 
original image is mapped on ^ virtual object by the texel 
interpolation method while shifting the texture coordinates can 
be used to defocus the original image. 

The texel interpolation method is not limited to 
particular processes, but it is a process to obtain image 
information of a pixel by interpolating image- information of 
a texel, and there is bilinear filtering or trilinear filtering, 
for example. 

A virtual object may be primitive surfaces such as 
polygons or the like, or may be a three-dimensional object. 
Although it is desirable that the virtual object is not 
displayed on a screen, it may be displayed on the screen. 

When a def ocused image is generated by texture mapping 
using texel interpolation method, it is desirable that the 
texture coordinates are shifted by a value smaller than one 
texel- After texture mapping using texel interpolation method 
is performed by shifting the texture coordinates in a direction 
of a first shift, texture mapping using texel interpolation 
method may be carried out again by shifting the texture 
coordinates in a direction of a second shift. Alternatively, 
a set of shifting in directions of a first shift and a second 
shift may be repeated several times. 

In the game system, information storage medium or program 
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* of the present invention, the second depth value may be clamped 
Into a given value depending on a bit value other than the bits 
I co J in the depth value* 

If a bit other than the bits I to J in the depth value 
5 becomes one 1, this configuration can generate a consistent 
image. The given value may be any of various values such as the 
maximum or minimum values of the second depth value* or a value 
in which a train of higher bits of the second depth value set 
to 1 and so on. 

10 In the game system, information storage medium or program 

of the present invention, the depth value may be set as an index 
^rJ number in a lookup table for index color texture -mapping; and 

w 

the depth value may be transformed into the second depth value 

'in 

^~ by performing index color texture -mapping on a virtual object 

fU 15 by using the lookup table. 

5 

^ In this configuration, a variety of transformation 

pf processes, including clamping of the second depth value into 

yi a given value, can be implemented with a reduced processing load 

p| in which only the transforming properties of the lookup table 

2 0 are changed. 

A virtual object may be primitive surfaces such as 
polygons or the like, or may be a three-dimensional object. 
Although it is desirable that the virtual object is not 
displayed on a screen, it may be displayed on the screen. 
25 In the game system, information storage medium or program 

of the present invention, bits M to N in the depth value may 
be set as an index number in a first lookup table for index color 
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texture -mapping; the depth value may he transformed into a third 
depth value by performing index color texture -mapping on a 
virtual object by using the first lookup table; bits K to h (where 
KSs^L>MStfSN) i n the depth value may be set as an 
index number in a second lookup table for index color 
texture -mapping; the depth value may be transformed into a 
fourth depth value by performing index color texture -mapping 
on a virtual object by using the second lookup table; and the 
third and fourth depth values maybe used to determine the second 
depth value. 

In such a manner, if there is a restriction by which only 
a train of bits within a given range of the depth value (e.g., 
0 to 7, 8 to 15, 16 to 23 or 24 to 31 bits) can be fetched, the 
second depth value formed of any bits between I and tf in the 
depth value can be obtained. Thus, the effective number of 
partitions in the alpha value (or the effective number of 
threshold steps in the depth value) can be increased to improve 
the quality of generated images. 

The present invention further provides a game system 
which generates an image, comprising: means which sets bits M 
to N in given image information as an index number in a first 
lookup table for index color texture -mapping, and uses the first 
lookup table to perform index color texture -mapping on a virtual 
object to transform the image information into third image 
information; means which sets bits K to L in the image 
information as an index number in a second lookup table for index 
color texture -mapping, and uses the second lookup table to 
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* perforin index color texture -mapping on a virtual object to 
transform the image information into fourth image information; 
and. means which determines second image information formed of 
the bits I to J (where kSiSl>kSjSn) in the image 
5 information based on the third and fourth image information. 
The present invention further provides a computer -usable 
information storage medium comprising a program for a computer 
to realize the above -described means. The present invention 
still further provides a computer- usable program {including a 
10 program embodied in a carrier wave) comprising a processing 
routine for a computer to realize the above -described means, 
gj Even if there is a restriction by which only a train of 



Ul 
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bits within a given range of the image information (e.g., 0 to 



EH 7, 8 to 15, 16 to 23 or 24 to 31 bits) can be fetched, the second 

ru 

3 15 image information formed of any bits between t and J in the image 



information can be obtained according to the present invention . 

The present invention can effectively use the index color 
P texture -mapping function originally possessed by the game 

system (or image generating system) for transforming the image 
20 information into the second image information. The 
transformation of the image information can easily be carried 
out for the entire display screen with increased speed and 
without addition of any hardware. 

The image information or second image information may be 
25 one drawn in a drawing region (e.g., frame buffer or additional 
buffer) and include color information, alpha value, depth value 
or the like. 



* In the game system, information storage medium or program 

of the present invention, the virtual object may be a polygon 
having a size equal to a size of a display screen. 

In this conf iguration, the depth value in an original 

5 image for the entire display screen can be transformed into an 
alpJia value through a single or several times of texture mapping, 
for example. 

Alternatively, in the game system, information storage 
medium or program of the present invention , the virtual object 
p 10 may be a polygon having a size eciual to a size of a block obtained 

v0 by dividing a display screen into blocks. 

In this configuration* a region in which a virtual object 



is drawn can be reduced in size to save the capacity of the memory 



m to be used. 

FU 

is 

M 
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Fig. 1 is a block diagram of a game system according to 



BRIEF DESCRIPTION OF THE DRAWINGS 



this embodiment of the present invention. 

Figs. 2A and 2B illustrate first and second techniques 
20 for realizing the gamma correction. 

Fig. 3 illustrates the index color texture -mapping 
process . 

Fig. 4 illustrates a technique of transforming an 
original image by effectively using an index color texture - 
25 mapping lookup table. 

Figs. 5A and SB show game images generated according to 
this embodiment. 
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* Fig. 6 illustrates a technique of dividing an original 

image into blocks , the image in each block being texture-mapped 
on a polygon having a size equal to a divided screen block. 

Fig. 7 illustrates a masking technique for only drawing 
5 the neceeeary image information among the image information 
obtained by transformation in I*UT so that the other image 
information will not be drawn. 

Fig. 8 illustrates a technique of forming an alpha (a) 
plajae through the texture mapping using LOT. 
10 Pig. 9 illustrates a technique of setting Z -value as an 

43 index number in LUT . 

Pig. 10 illustrates a technique of setting an alpha value 

% \ 

^ depending on a z-value and then using the set alpha value to 

blend an original Image with its defocused image. 

w ■ ■ 

15 Figs. 11A and 11B show an original image and its defocused 



i i 

1)1 



image . 

Fig. 12 illustrates a technique of setting alpha values 
depending on Z -values. 
r h Figs. 13A, 13B and 13C illustrate a technique of updating 

20 the alpha value of a deeper a pixel from a virtual object by 
drawing the virtual object. 

Fig. 14 illustrates a technique of transforming a Z-value 
into a Z2 -value and transforming that Z2- value into an alpha 
value for blending an original image with its defocused image. 
25 Fig. IS illustrates a problem raised if the Z2 -value is 

formed by higher bits including the most significant bit in the 
z -value . 
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* Fig. 16 illustrates a technique of forming the Z2 -value 

by lower bits I to J than the most significant bit of the 2 -value 
and clamping the Z2~ value at a given value - 

Fig. 17 illustrates a technique of using LUT to transform 
5 a Z -value into a Z2 -value. 

Fig. 18 shows an example of LUT1 for transformation of 
the bits 15 to 8 in the Z- value. 

Fig. ±9 shows an example of LUT 2 for transformation of 
the bits 23 to 16 in the Z- value. 
10 Figs. 2 OA and 2 OB illustrate an example of LUT 3 for 

m — 

s&j transformation of 22 -value into alpha value and its 

lj characteristic curve of transformation. 

^ Fig. 21 illustrates the clamping process. 

m 

gl Fig. 22 illustrates the bilinear filtering type texture 
PJ 

15 mapping. 

M* Fig. 23 illustrates a technique of generating a defocused 

□ 

^ image by effectively using- the bilinear- filtering mode. 

|j Fig. 24 also illustrates a technique of generating a 
defocused image by effectively using the bilinear filtering 



2 0 mode* 

Figs. 25A and 25B illustrate a principle of generating 
a defocused image through the bilinear filtering type 
interpolation . 

Figs. 26A and 26B also illustrate a principle of 
25 generating a defocused image through the bilinear filtering 
type interpolation. 

Fig, 27 is a flowchart illustrating the detailed process 
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* of this embodiment. 

Fig. 26 is a flowchart illustrating the detailed process 
of Chis embodiment. 

Fig . 29 shows a structure of hardware in which this 
5 embodiment can be realized. 

Figs. 30A, 30B and 30C show various systems to which thiB 
embodiment can be applied. 

BEST MODE FOR CARRYING OUT THE INVENTION 
10 One preferred embodiment of -the present invention will 

D 

y3 now be described in connection with the drawings. 

& .. 

y 

V J l 

ui... 

B! Fig. 1 shows a block diagram of a game system (or image 

PJ 

15 generating system) according to this embodiment. In this figure, 
this embodiment may comprise at least a processing section 100. 

□ 

^ Each of the other blocks may take any suitable form. 

in 



□ 



Configuration 



The processing section 100 performs various types of 
H 1 processing for control of the entire system, commands to the 

2 0 respective blocks in the system, game processing, image 
processing, sound processing and so on* The function thereof 
may be realized through any suitable hardware means such as 
various processors (CPU, DSP and so on) or ASIC (gate array or 
the like) or a given program (or game program) . 
25 An operating section 160 is used to input operational data 

from the player and the function thereof may be realized through 
any suitable hardware means such as a lever, a button, a housing 
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** or the like. 

A storage section 17 0 provides a working area for the 
processing section 100, communication section 174 and others. 
The function thereof may be realized by any suitable hardware 
5 means 3uch as RAM or the like. 

An information storage medium (which may be a 
computer -usable storage medium} 180 stores information 
including programs, data and others. The function thereof may 
be realized through any suitable hardware means such as optical 
10 memory disk (CD or DVD) , magneto -optical disk (mo) , magnetic 
disk* hard di3k, magnetic tape, memory (ROM) or the like. The 



UJ processing section 100 performs processing in the present 

invention (or this embodiment) based on the information that 



in 

m 

ru ' •• 

e 15 words, the information storage medium 180 Stores various pieces 



Q 



has been stored in this information storage medium 180. in other 



of information (programs or data) for causing a computer to 
& h realize the means of the present invention (or this embodiment) 

in 

P. which are particularly represented by the blocks included in 

the processing section 100. 

2 0 Part or the whole of the information stored in the 

information storage medium 150 will be transferred to the 
storage section 17 0 when the system is initially powered on. 
The information stored in the information storage medium 18 0 
may contain at least one of program code set for processing the 

25 present invention, image data, sound data, shape data of objects 
to be displayed, table data, list data, information for 
instructing the processing in the present invention. 
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information for performing the processing according to these 
instructions and so on. 

A display section 190 is to output an image generated 
according to this embodiment and the function thereof can he 
realized by any suitable hardware means such as CRT, LCD or HMD 
(Head -Mount Display) . 

A sound output section 192 is to output a sound generated 
according to this embodiment and the function thereof can be 
realized by any suitable hardware means such as loudspeaker. 

A portable, i^^orjnation.s to rage de vJ.ce 194 is to store the 
player's personal data (or data to be saved) and may be take 
any suitable form such as memory card, portable game machine 
and so on. 

A communication section 196 performs various controls for 
communication between the game system and any external device 
(e.g. . host machine or other game system) . The function thereof 
may be realized through any suitable hardware means such as 
various types of processors or communication ASIS or according 
to any suitable program. 

The program or data for realising (or executing) the means 
in the present invention (or this embodiment) may be delivered 
from an information storage medium included in a host machine 
(or server) to the information storage medium 180 through a 
network and the communication section 195. The use of such an 
information storage medium in the hose device (or server) falls 
within the scope of the invention. 

The processing section 100 further comprises a game 
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processing section 110, an image generation section 13 0 and a 
sound generation section 15 0. 

The game processing section 110 performs various 
processes such as coin (or charge) reception, setting of various 
modes, game proceeding, setting of screen selection, 
determination of the position and rotation angle (about Y- 
or 2 -axis) of an object (or one or more primitive surfaces) , 
movement of the object (motion processing), determination of 
the view point (or virtual camera' position) and visual -line 
angle (or rotational virtual camera angle) , arrangement of an 
object such as mapped object within the object space, hit 
checking, computation of the game results (or scores) , 
processing for causing a plurality of players to play in a common 
game space, various game computations including game -over and 
other processes, based on operational data from the operating 
section 16 0 and according to the personal data and game program 
from the portable information storage device 194, 

The image generation section 13 0 performs image 
processing according to the commands or the like from the game 
processing section 110, For example, the image generation 
section 130 may generate an image within an object space as 
viewed from a virtual camera (or viewpoint) . which image is in 
turn outputted toward the display section 190. The sound 
generation section 150 performs various sound processing 
according to the commands and the like from the game processing 
section 110 for generating BGMs, sound effects, voices or the 
like which are in turn outputted toward the sound output section 
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192 . 

All the functions of the game processing section 110 and 
the image and sound processing sections 13 0, 150 may be realized 
by any suitable hardware means or according to the program. 
5 Alternatively, these functions may be realized by both the 
hardware means and program* 

The game processing section 110 further comprises a 
movement/action computation section 112, 

The movement /act ion computation section 112 is to 
p 10 calculate the information of movement for objects such as 

'^5 motorcars and so on (positional and rotation angle data) and 

the information of action for the objects (positional and 
yij- rotation angle data relating to the parts in the objects) - For 

example, the movement/action computation section 112 may cause 

ru 

tt 15 the objects to move and act based on the operational data 



inputted by the player through the operating section l€Q and 
according to the game program. 

More particularly, the movement/ action computation 



Ul . 

W . section 112 may determine the position and rotational angle of 



20 the object, for example, for each one frame (1/60 seconds) . For 
example, it is now assumed that the position of the object for 
(k-1) frame is PMk-l, the velocity is VMk-1, the acceleration 
is Amk-1, time for one frame is At. Thus, the position PMk and 
velocity VMk of the object for k frame can be determined by the 

25 following formulas (l) and (2) : 

PMk - PMk-l * VMk-l X At (1) 
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VMk - VMk-i + Amk-1 X At 



<2) 



The Image generation section 130 comprises a 
geometry-processing section 132, an index number setting 
section 134 and a drawing section 14 0. 

The geometry-processing section 132 performs geometry 
processing (or three-dimensional computations) such as 
coordinates transformation. clipping. perspective 

transformation, light-source calculation and so on. After 
AvM«cted_.. to . the geometry -processing {or-- perspective 
transformation) , the object data (such as shape data including 
the vertex coordinates and others in the object, or vertex 
texture coordinates, brightness data and the like) is saved in 
a main storage region 172 in the storage section 170. 

The index number setting section 134 is to set the image 
information of the original image (e.g., perspective- 
transformed image information) as an index number in an LUT 
(lookup table) storage section 178 for an index color 
texture -mapping. The image information of the original image 
may take any of various information forms such as color 
information (ROB . yuv or the like), alpha value (or any 
information stored in association with each of the pixels, other 
than the color information), depth value (z-value) and so on. 

In this embodiment, a lookup table in which the depth 
value for each pixel in the original image is set at an index 
number is used to perform the index color texture- mapping 
relative to a virtual object such that the alpha value for each 
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pixel depending on the depth value for each pixel in the original 
image will be set. Thus, a so-called depth of field or fogged 
image can be represented according to this embodiment. 

It is desirable that the correspondent relationship 
between the depth value (index-number) and alpha value for each 
pixel in the LUT (lookup table) is so set that as a pixel is 
located farther from the focus of the virtual camera* the alpha 
value thereof increases (or has a higher blending rate of the 
def ocused image in a broad sense) ♦ In addition, the depth of 
field or defocusing effect may variably be controlled by 
changing the correspondent relationship between the depth value 
and alpha value for each pixel in the LUT. 

The drawing section 140 is to draw the geometry-processed 
object (or model) in a drawing region 174 (which is a region 
in a frame buffer, an additional buffer or the like for storing 
the image information by a pixel unit) . The drawing section 14 0 
comprises a texture mapping section 142, an alpha blending 
section 144 and a hidden surface removal section 146. 

The texture mapping section 142 performs a process of 
mapping a texture stored in the texture storage section 17 6 onto 
an object (including a process of specifying a texture to be 
mapped on an object, a process of transferring a texture and 
other processes) . In such a case, the texture mapping section 
142 can perform the texture mapping using the index color 
texture -mapping LUT (lookup table) stored in the LUT storage 
section 178. 

In this embodiment, the texture mapping section 142 



19 



*" performs the texture mapping relative to the virtual object 
(such as a polygon having a sifce equal to that of the display 
screen, a polygon having a size equal to a size of a block of 
divided screen and the like) using the LUT in which tjie image 
5 information of the original image is set as an index number. 
Thus, a process of transforming the depth value (Z-value) into 
Nbits, a process of transforming the depth value into the alpha 
value and various other image transforming processes (e*g. f 
gamma correction, negative/positive inversion, posteri2ation r 
« 10 solarization, binarization, ...mono^tone filtering and sepia 



M3- filtering) can be realized with reduced processing load. 

y In addition, this embodiment implements the generation 



of a def ocused image (or most-def ocused image} blended with the 
£H original image through the alpha blending (such as narrow- 

8 IS sensed alpha blending, additive alpha blending, sub tractive 

^ alpha blending, or translucency processing) by effectively 

M utilizing texture mapping by texel interpolation method 



U1 
O 



(bilinear or trilinear filtering) . 

More particularly, the texture mapping section 142 maps 

2 0 the original image set as a texture on the virtual object (which 
is an object having its shape equal to that of the def ocused 
region) through the texel interpolation method while, for 
example, shifting the texture coordinates by a value smaller 
than one pixel (texel) (or shifting it from the texture 

25 coordinates obtained based on the drawn position of the original 
image)- Thus, the def ocused image to be blended with the 
original image can be generated through a simplified procedure 
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* by which the texture coordinates are only shifted. 

The alpha -blending section 144 is to blended an original 
image with its defocused image based on an alpha value (A value) 
which has been set for each of the pixels in the drawing region 

5 174 (a frame buffer or the like) . For example, when a narrow 
sensed alpha blending is performed, the original image is 
blended with the defocused image as represented by the following 
formulae: 



io . - R Q - <i. ---a) x R t + a x R3 <3) 
*0 0 Q - <l - a) X ©! ♦ a x g 3 <4) 

yj b 0 - (1 - a) x B a + a x b 3 <5) 

M 
VI 

where R lr Gj and B t are respectively color (or brightness) R, 

fU 

§ 15 G and B components in the original image already drawn in the 

p drawing region 174; R a , G 2 and B a are respectively color R, G 

?h and B components in the defocused image; and Rq, G 0 and B Q are 

p j. respectively R, G and B components generated through the alpha 

H 5 blending. 

2 0 An image on which alpha blending (such as narrow- sensed 

alpha blending, additive alpha blending, sub tractive alpha 
blending, or translucency processing) is performed together 
with an original image is not limited to a defocused image of 
the original- image. For example, alpha blending may be performed 
25 on an original image and any other image. Alternatively, alpha 
blending may be performed on an original image and its 
transformed image (transformed by gamma correction. 
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negative/positive inversion, posterization, solarization, 
binarization, mono -tone filtering, sepia filtering or the 
liKO) - 

The hidden surface removal section 145 performs the 
hidden- surface removal according to Z -buffer algorithm, using 
a z buffer (or z plane) 179 in which the Z-value (depth value) 
is stored. In this embodiment, the z-value written in this Z 
buffer 179 is transformed into alpha value on which the original 
image is blended with the defocused image, 

-The game system of this embodiment may be dedicated for 

a single -player mode in which only a single player can play the 
game or may have a multi- player mode in which a plurality of 
players can play the game. 

If a plurality of players play the game, only a single 
terminal may be used to generate game images and sounds to be 
provided to all the players. Alternatively, a plurality of 
terminals (game devices or portable telephones) interconnected 
through a network (transmission lien or communication line) may 
be used in the present invention. 

2. Features of the embodiment 
2.1 Index color texture -mapping 

It is desirable that upon generation of an image in the 
game system, a certain transformation called gamma correction 
is subjected to the image to correct a non- linear property in 
a monitor (or display section) . 

There are first and second techniques for realizing such 
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* a gamma correction which will be described below. 

The first technique has provided a gamma correction LUT 
(lookup table) in a main memory 802 r as shown in Fig. 2A. CPU 
80 0 (or a software running on the CPU) then reads the color 

5 information (RGB) for each pixel in an original image from a 
frame buffer $08 within VHAM 806* The read color information 
is then used to refer to the gamma correction LUT and to provide 
the gamma -corrected color information. The resulting gamma 
corrected color information is then drawn back to the 
£3 10 corresponding pixel in the frame buffer, such a process will 

be repeated for all the pixel in the original image. 

y 

i 



On the other hand, the second technique provides a 
gamma -correction circuit 814 for realizing the gamma correction 
in hardware, which is located downstream of a drawing processor 



15 812 running under the control of the COU 810, as shown in Fig. 

1*4 

g3 2B. The gamma- correction circuit 814 performs the gamma 

Ul 

□ drawing processor 812, the gamma- corrected color information 



correction relative to the color information generated by the 



being finally outputted toward a monitor 816. 

2 0 However, the first technique shown in Fig. 2A uses the 

software running on the CPU 800, which software must performs 
all the processing such as reading of the color information from 
the frame buffer 808, referring to the gamma correction LUT 804, 
reading the color information out of the gamma correction LUT 

25 804 and writing of the read color information back to the frame 
buffer 808. Thus, the processing speed will not be increased. 
It is thus difficult to complete the gamma correction relative 
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* to all the pixels on the display screen within one frame. The 
processing load on the CPU 800 will extremely be heavy, thus 
adversely affecting any other processing. 

On the other hand, the second technique of Pig. 2B can 
5 increase the speed of gamma correction since it uses a 
gamma- correction circuit which is of a dedicated hardware* Thus, 
the second technique can easily complete the gamma correction 
for all the pixels on the display screen within one frame. 
Moreover, the second technique can overcome such a problem as 
XO adversely affecting .any _pther_ processing since the processing 

C3 

k q load on the CPU 810 is reduced. 

f . However, the second technique of Fig. 2B requires a 

separate gamma- correction circuit 814 which is a dedicated 
^ hardware. The game system will he increased in scale and raise 

T 

PJ 15 another problem in that the manufacturing cost is increased. 

Particularly, the domestic game systems are severely 
^ required to be reduced in manufacturing cost for more 

Ul popularization. Therefore, most domestic game systems did not 

P 

have such a gamma- correction circuit as shown in Pig. 2B as 
20 hardware. In order to realize the gamma correction, such 

domestic game systems cannot but take the first technique as 

shown in Fig. 2A. 

As described, however, it is difficult that the first 

technique completes the gamma correction for the entire- display 
25 screen within one frame, thereby adversely affecting any other 

processing. As a result, the domestic game systems cannot but 

abandon the gamma correction itself. 
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The inventors aimed at the loofcup table LOT used in the 
ittd.ex color texture -mapping process. 

In the index color texture -mapping process, an index 
number, rather than the actual color information (RGB) , is 
stored in association with each texel in a texture to save the 
capacity of the texture storage section to be used, as shown 
at Al in Fig. 3. In addition, as shown at A2 in Fig, 3, the color 
information specif ied by the index number is stored in the index 
color texture -mapping I*UT (color pallet) . When the texture 
mapping is to be performed on an object, the IjTIT is referred 
to based on the index number for each texel in the texture and 
the corresponding color information is read out of the IAJT. The 
read color information is then drawn in a frame buffer. 

The number of colors used on the texture mapping in such 
an index color mode is reduced, for example, into 256 colors, 
in comparison with the conventional texture mapping that do not 
use the JjVT, However, the capacity of the texture storage 
section to be used can greatly be saved since it is not reguired 
to store the actual color information (e.g., 16-bit color 
information) in the texture storage section. 

This embodiment is characterized by using such an index 
color texture -mapping process in an unusual manner. 

More particularly, the image information (e.g., color 
information) for each pixel in an original image drawn \n a frame 
buffer (which is, in a broad sense, a drawing region) is first 
set (or considered) as an index number in a gamma- correction 
lookup table LUT, as shown at Bl in Fig. 4. Next, the in 



which the image information of the original image has been set 
as the index number is used* to perform the index color 
texture -mapping relative to an virtual object <e.g, , a polygon 
having its size equal to that of the display screen) for 
transformation of the image information of the original image, 
as shown at B2 in Fig- 4. The transformed image information is 
finally drawn back to the frame buffer (or drawing region} , as 
shown at B3 in Fig- 4. 

In such a manner, this embodiment successfully provides 
the-gamma- corrected image shown -in Fig . -SB- from the original 
image shown in Fig. 5A. It is to be noted that the image of Pig. 
5B is more contrasted than that of Fig- 5A. 

In the first technique of Fig- 2A, all the processing such 
as reading of the color information in the original image, 
referring to the gamma -correction LUT, writing of the color 
information back to the frame buffer and others will be 
performed in software running on CPU. Thus, the processing speed 
cannot be increased with increase of the processing load on CPU. 

On the contrary, this embodiment realizes the gamma 
correction by effectively using the index color texture -mapping 
process. The index color texture -mapping process is 
accomplished at higher speed by a drawing processor (or drawing 
section) which is a dedicated hardware. According to this 
embodiment, thus, the gamma correction can be executed at a 
speed higher than that of the first techni<£ue shown in Fig, 2A 
such that the gamma correction for the entire display screen 
will easily be completed within one frame {e.g., 1/60 seconds 



or 1/30 seconds) . 

Since the index color texture -mapping process is executed 
by the drawing processor separated from the main processor (CPU) , 
the processing load on the main processor can be minimized. As 
a result, the gamma correction- can be prevented from adversely 
affecting any other processing. 

The processing ability of the drawing processor in the 
conventional game systems was not very high. It was thus 
difficult that the drawings of the original image into the frame 
buffet" and of the polygon having its size equal to that of the 
display screen were completed within one frame. 

However, the processing ability of the drawing processor 
in the game system has now been highly improved in coxftparison 
with the processing abilities of the other circuit blocks. 
Recently, a drawing processor having its very high fill rate 
(or the number of texele renderable for one second) has been 
used in the field of game system. Therefore, it becomes easy 
that the drawings of the original image into the frame buffer 
and of the polygon having its size egiial to that of the display 
screen are completed within one frame. The gamma correction 
effectively using the index color texture -mapping process has 
been capable of being naturally realized. 

The second technique of Fig* 2B requires a separate 
gamma -correction circuit which is a dedicated hardware f leading 
to increase of the manufacturing cost. In the domestic game 
systems which did not originally include such a gamma - 
correction circuit, they cannot realize the second technique 
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of Fig. 2B, but take the technique of Fig. 2A. 

On the contrary, this embodiment realizes the gamma 
correction by effectively using the index color texture -mapping 
process. The index color texture -mapping process is executed 
through a hardware structure originally included in the drawing 
processor. According to this embodiment, therefore, such a 
gamma- correction circuit as shown in Fig. 2B is not newly 
repaired. This can prevent the game system from being expensive. 
Even in the domestic game systems not originally having the 
gaxnma - correction circuit, the high-speed gamma correction can 
be realized in hardware. 

Although Fig. 4 shows the gamma correction (video 
filtering) implemented by texture mapping on a polygon having 
a size equal to a size of a display screen, texture mapping may 
be performed on a polygon having a size of a block obtained by 
dividing the display screen into blocks. 

More particularly, an original image (or display screen) 
on a frame buffer is divided into blocks, as shown at Cl in Fig. 
6 . The divided image of each block is texture -mapped on a polygon 
having a size equal to a size of a divided screen block by using 
an IiTJT, as shown at C2 in Fig. 6. Finally, the resulting image 
having a size equal to a size of divided screen block is drawn 
back to the frame buffer (or drawing region) . 

Alternatively, a polygon may be generated which includes 
the whole ox part of the image of a perspective- transformed 
object (which has been transformed into the screen coordinate 
system) and has its magnitude variable depending on that of the 
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per-spective- transformed object. The texture mapping may be 
performed on that polygon. 

Thus, an area on VRAM occupied by an additional buffer 
can be reduced, for example, when the texture mapped. polygon 
5 is to be temporarily drawn in- the additional buf £ or* 

When the texture mapping is performed on a polygon having 
a size equal to that of the display screen as shown in Fig. 4, 
an additional buffer having a size equal to that of the display 
screen must be allocated on VRAM for temporarily drawing the 
10 polygon having a size equal to that of the display screen. This 

C3 

may adversely affect any other processing. 



If the texture mapping Is performed on a polygon having 



V J a size equal to a size of a block of divided screen as shown 

ill 

in Fig- 6, it is only required that an additional buffer having 
15 a size equal to a size of the block is provided on VRAM. Therefore, 

r: 

M* the area occupied by the additional buffer can be reduced- As 

a result, the limited hardware resource can effectively be 

U1- utilized. 

P 

20 2.2 Masking 

The gamma correction requires such an LOT that one value 
(ROUT, GOUT or BOUT) will be outputted relative to one input 
value (RIN, GIN or BIN) . 

However* the index color texture* mapping LUT sho^n in Fig. 
25 3 will output a plurality of values (e.g. , ROUT, GOUT and BOUT) 
relative to one input value (or index number) . This is a problem 
in that such an LUT has a mismatch to be overcome. 
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* Thus, this embodiment: uses a masking process for only 

drawing the necessary image information piece in the 
transformed image information in a drawing region (a frame 
buffer or an additional buffer) without drawing any other image 

5 information pieces when the image information in the original 
image (e.g., R, G, B, Z-value or alpha value) is Co be set as 
an index number in the I»UT. 

More particularly, as shown at Dl in Fig. 7, the R-plane 
value in an original image is set as an index number in an i*UT 

10 which is. in turn used to perfonn. the -texture mapping to-output 

three plane values , R (ROUT) , G(GOUT) and B (BOUT) * Xn such a case , 
only the outputted R-plane values are drawn in the drawing 
region while the G- and B -plane values are masked and not drawn 



U1 ' ' 

in the drawing region, as shown at D2 in Fig. 7. 



15 If the G-plane value in the original image is set as an 



index number for texture mapping as shown at D3 in Fig- 7, only 

f 3 

, , ■' the output ted G -plane value is drawn in the drawing region while 

Ul the R- and B -plane values are masked and not drawn in the drawing 

a 

^ region, as shown at D4 in Fig. 7. 

20 If the B-plane value in the original image is set as an 

index number for texture mapping as shown at D5 in Fig. 7, only 
the output ted B-plane value is drawn in the drawing region while 
the R- and G -plane values are masked and not drawn in the drawing 
region, as shown at D4 in Fig. 7. 

25 In such a manner, the original image can be subjected to 

the image transformation with less processing load while using 
the index color texture-mapping LUT not originally designed for 
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the gamma correction. 



2.3 Application to Z-value and alpha value 

The use of the color information R, G, B outputt.ed based 
5 on the index color texture -mapping LUT has been described . 

However, alpha value (A- value; information set in 
association with a pixel, other than the color inf ormation) 
outputted based on the index color texture -mapping lut may be 
used. 

10 Per example, as shown in Fig. 8, R- „ G- or B- plane value 

a 

yj- may be set as an index number in an LOT which is in turn used 

yj to perform the texture mapping for generating an alpha {Of OUT) 

%l plane- The generated alpha plane is then used to perform the 

UT 

masking or other process. 

PA 

' ~ 15 For example, there may be used an l*UT in which the alpha 

s 

( a OUT) value is set to be zero when the R- value is between 1 

□ 

^ and 127 and to be 255 when the Revalue is between 128 and 255. 

W The masking process is not performed for a pixel having its alpha 

□ 

[Mi value smaller than 255, but will be made only for a pixel having 

20 its alpha value equal to 255. In such a manner, the masking 
process will be performed only for pixels having their R- value 
equal to or larger than 128, This enables the masking process 
to be made depending on the magnitude of the R-value in each 
pixel . 

25 The generated alpha plane value may be used as an alpha 

blending coefficient (transparency, translucency or opacity) . 
The image information set as the index number in the LUT 
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* is not limited to the color information and may be one that is 
on the drawing region (VRAM) and can set as the index number 
in the lut. 

For example, as shown in Fig. 9, the 2 -value (or depth 
5 value) may be set as the index number in the lut . 

In such a case, the alpha plane value obtained by 
performing the index color texture -mapping after the z value 
has been set as an index number may be used as an alpha blending 
coefficient, for example. Thus, an alpha value can be set 

10 depending on -the Z value so that the depth of field or the like 

can be represented by using a defocused image. 
y3 When such an I#UT as shown in Fig. 9 is used to perform 

yj 

V| the texture mapping , alpha values, a A, QfB, aC and as for the 

Sri 

Ji respective pixels A, B, c and ID in an original image are set 

Li] 

PJ 15 at values corresponding to- the respective pixel Z -values, ZA, 

s 

^ ZB, ZC and ZD of the original image, as shown at Pi in Fig. 10. 

0" Thus, such an alpha plane as shown at F2 in Fig- 10 is generated. 

Ul More particularly, the alpha value in a pixel may be set larger 

C3 

^ as that pixel is located farther away from the focus of a virtual 

20 camera 10 (or a gazing point) or when that pixel has its z- 
value more different from that of the focus, *hus, the blending 
ratio of defocused image will be increased as the pixel is 
farther from the focus of the virtual camera 10 . 

Next, as shown at F3 in Fig. 10, alpha blending of the 
25 original image and its defocused image is carried out based on 
the generated alpha plane (or the alpha value set for each pixel) . 
Fig. HA shows such an example of original image while Fig. 11B 
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* shows its defocused image- 

By performing alpha blending of the original image (Fig. 
11A) and its defocused image (Fig. 11B) based on the alpha values 
set depending on the 2 values (or depth values) in such a. manner, 
5 for example, an image can be generated in which the degree of 
def ocusing therein will be increased as the pixels thereof are 
spaced farther apart from the fociiB of the virtual camera (that 
is, a focused point) . This enables a so-called depth of field 
to be represented- Thus, unlike a conventional game image in 
10 which all objects in a screen are focused, this embodiment can 
generate a more realistic and natural image focused depending 



V«? on the distance from a viewpoint like a real view. As a result, 

U J 

r,,j the player's feel for virtual reality can highly be improved. 



Pig. 12 exemplifies alpha, values set depending on Z- 



$ ! J is values* In this figure, each of the alpha values is normalised 

s 

^ to has its magnitude equal to or smaller than 1.0. 

Q 

UI ARl * • AR4 • by Z-values (threshold values) Zl-Zd and 21 1 -Z4', 



In Fig. 12, the area is partitioned into AR0-AR4 and 



respectively. Relative to these areas AR0-AR4 and ARl • -AR4 * # 
20 alpha values a0 to a 4 and al' to ot4' are set respectively. 

For example, a pixel located in the region ARl between 
Zl and 22 may have its alpha value set at al: a pixel located 
in the region AR2 between 22 and Z3 may have its alpha value 
set at a2; a pixel located in the region ARl 1 between 21 ■ and 
25 Z2' may have its alpha value set at al"; and a pixel located 
in the region AR2 • between 22' and Z3 1 may have its alpha value 
set at a2 » . 



33 



The alpha values for the respective regions may be 
represented by the following relational expressions: 

clo < ai < a2 < a3 < a4 . (6) 

ao < ai B < <x 2 1 < a3' -< a4* (7) 

AS will be apparent from these formulas (6) and (7) , the 
alpha value is increased as the pixel is located farther from 
the focus of the virtual camera 10 (or a gazing point) . In other 
words j th'e alpha value"is so set that the rate of blending between 
the original image and its defocused image is Increased as the 
pixel has a larger difference between its z value and the Z value 
of the focus of the 'virtual camera 10 . 

By so setting the alpha value, a more defocused image can 
be generated as the pixel is located farther apart from the focus 
Of the virtual camera. This enables a so-called depth of field 
to be^ represented. 

And yet, this embodiment is advantageous in that the 
processing load thereof is highly reduced since the z value for 
each pixel can be transformed into the alpha value through only 
a single texture mapping using the I*UT. 

One of the alpha value setting techniques not using the 
LUT may be considered to be such a technique as shown in Figs. 
13A, 13B and 13C. 

As shown in Fig. 13A, the alpha value of a deeper pixel 
from a virtual object OBI (or polygon) having its Z value set 
as Zl is updated by drawing it in a frame buffer. In other words, 



34 



* the alpha value of the deeper pixel from the object OBI is updated 
by effectively using the hidden- surf ace removal based on the 
Z value. 

Next, as shown in Pig. 13B, the alpha value for a. deeper 
5 pixel from a virtual object 0B2 having its Z value set at 22 
is updated by drawing it in the frame buffer. Similarly, as shown 
in Fig. 13 C, the alpha value for a deeper pixel from a virtual 
object OB3 having its Z value set at Z3 is updated by drawing 
it in the frame buffer. 
10 In such a manner, the alpha value of a pixel in the area 

Q AR1 can be set as al; the alpha value of a pixel in the area 

y3 AR2 can be set as CK2; and the alpha value of a pixel in the 

W 

vj area AR3 can be set as at 3 . In other words, the alpha value for 

^ each pixel can be set at a value corresponding to the Z value 
nJ 15 thereof. 

L ^ However, this technique requires that the virtual object 

^3 drawing process is repeated times corresponding to the number 

jjf of threshold steps for Z value. For example, in Fig. 12, the 

f 3 " 

JV drawing process should be repeated eight times . This is 

20 disadvantageous in that the drawing load is increased. On the 
contrary, if the number of threshold steps is reduced to relieve 
the drawing load, the boundary between the threshold Z values 
will be viewed as a stripe on the display screen, leading to 
reduction of the image quality. 

25 According to the technique of this embodiment in which 

the Z value is transformed into the alpha value using the LUT, 
the Z values for all the pixels can be simultaneously be 
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* transformed Into alpha values at a time. If the index number 
(entry) In the LUT is of 8 bits, the alpha values partitioned 
by 2 56 threshold Z value steps can be obtained. It can be 
prevented that the boundary between the threshold Z values will 

5 be viewed as a stripe on the display screen. Therefore, a 
high-<auality Image can be generated with reduced processing 
load * 



2.4 Formation of 8 -bit Z value 
20 *?o improve the accuracy of the hidden-surface removal in 

VlJ the game system, the number of bits in the Z value is very large, 

such as 24 bits or 32 bits. 



ur 



On the other hand, the number of bits in the index number 



■U' (entry) of the index color texture -mapping LUT is smaller than 

w 

~ is that of the Z value, such as 8 bits. 

Where the Z value is to be transformed into the alpha value 

D 

M* using such an index color texture -mapping LUT as shown in Fig. 

ui ■ ■ 

9, therefore, a pre-process in which the 2 value is transformed 
^ into a Z value having the same number of bits as that of the 

20 LUT index number (which will be referred to Z2 -value) is 
required. If the number of bits in the LUT index number is 8 
bits, the Z value must be transformed into Z2 -value (or second 
depth value) of 8 bits. 

Xn this case, to obtain a consistent Z2 -value, up^er eight 

25 bits including the most*signif icant bit in the Z value must be 
used to form the Z2 -value* In Fig. 14, eight bits ranging between 
bit 23 (ox most -significant bit) and bit 16 is selected and used 
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to form the Z2 - value. 

It has been found, however, that if the upper bits ranging 
between bit 23 ana bit 16 in the 2 value are used to form the 
Z2 -value which is in turn transformed into the alpha valjue using 
5 the IjUT, the number of parti-tions for alpha value will be 
reduced. 

A3 shown in Fig. 15, for example , it is assumed that the 
Z value is of 4 bits and that the upper two bits of the z value 
are selected and used to form the Z2 -value. Xn this case, the 
10 alpha value will be partitioned into four threshold steps within 



v3 all the range of z ~ 0 to 15 . 

y However, an object in front of a screen SC 



(perspective- transformed screen} as shown at OBI in Fig . 15 will 



61 usually be near- clipped . If an object located in a range of Z 

ru 

6 15 » 10 to 15 in Pig. 15 is near-clipped, for example, it becomes 

^ rare that the most - significant bit in the Z value becomes one 

^,=* 

jp* (1) . In any event, the object as OB2 located near the screen 

in 

p SC is not retired that its degree of defocusing is accurately 

^ controlled since it will necessarily be formed to be the most 

2 0 defocused image. Therefore, two steps of partitioning the 
portion as shown by Gl in Fig. 15 are unnecessary. 

To avoid such a situation, this embodiment transforms the 
Z value (depth value) for each pixel in an original image into 
aZ2-value (second depth value) formed by lower bits I to J (e.g., 
25 bits 19 to 12) than the most- significant bit of the Z value* 
as shown in Fig. 14 . This 22 -value is then set as an index number 
in the index color texture -mapping LXJT and then performs the 
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texture mapping for determining the alpha value for each pixel. 
Based on the determined alpha value for each pixel, alpha 
blending of the original image and its defocused image is 
carried out. 

In such a manner, as shown in Pig. 16, the degree of 
defociiBing can accurately be controlled by using the alpha 
values which are partitioned with the multi-step thresholds 
(four steps in Fig. 16) only relating to some objects (e.g., 
0B3 and OB4) that are located near the focus of the virtual camera 
10 (ox a gazing point) . Thus, the quality of the generated image 
can be improved. 

In this embodiment, the 22 -value may be clamped at a given 
value depending on the bit values other than the z value bits 
I to J. More particularly, as shown in Pig. 16, the 22 -value 
may be clamped at the maximum value (which is, in a broad sense, 
a given value) when the upper bit in the Z value becomes one 
U) . for example. Thus, the Z2-value will be set maximum for 
any object which is not required to control its degree of 
defocusing accurately, such as OBI or OB2, A consistent image 
can be generated even though the Z value has been transferred 
into the Z2 -value formed by its bits I to J. 

2.5 Transformation of Z value using LUT 

This embodiment realizes the process of transforming the 
z value described in connection with Pig. 14 into the Z2 -value 
(transformation into 6 -bit form) by using the index color 
texture -mapping LUT for the texture mapping. In other words, 
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the Z value Is transformed into the 22 -value by setting the Z 
value as an index number in an MIT and using that I/OT to perform 
the index color texture-mapping relative to a virtual object. 

It is now assumed that a 24 -bit 2 value is transformed 
into a Z2-value using an LUT as. shown In Fig. 17. In this case, 
as shown at HI in Fig. 17, bits 15 to 8 (or M to N) in the Z 
value are set as index numbers in a first lookup table LUTl which 
is in turn used to perform the index color texture -mapping for 
transforming the Z value into Z3 -value (or third depth value) - 

Next, as shown at H2 in Fig. 17, bits 23 to 16 {or K to 
1») in the Z value are set as index numbers In a second lookup 
table LUT2 which is in turn used to perform the index color 
texture -mapping for transforming the Z value into Z4 -value (or 
fourth depth value) . 

Finally, as shown at H4 in Fig. 17 , these Z3- and 24 - 
values are used to determine 22 -value which is in turn 
transformed into alpha value by using a third lookup table LUT3 
as shown at H5. 

More particularly, the 33 -value obtained by the 
transformation of LUTl is drawn in a drawing region (a frame 
buffer or an additional buffer). Thereafter, the Z4 -value 
obtained by the transformation of LUT2 is drawn in the drawing 
rdgion. At this time, the 22 -value is determined while the lower 
four bits (or effective bits) in the Z3 -value are maske<3. so that 
these bits will not be overwritten by the Z4 -value. 

The technique of Fig. 17 enables any 8 bits (which are, 
in a broad sense, X to J) in the Z value to be fetched. 



39 



* If it is wanted to fetch 8 bite in the Z value for setting 

them as index numbers in the LUT, only 8 bits in the Z value 
witttin a predetermined range, such as bits 23 to 16, 15 to 8 
or 7 to 0, may be fetched. 

5 On the other hand, the type of 8 bits to be fetched in 

the Z value is determined depending on the range of near- 
clipping or the focus position of the virtual camera (or a gazing 
point), as described in connection with Figs. 14 and 15. 

If only 8 bits of the Z value within a predetermined range, 

^ 10 such as bits 23 to 16. IS to 8 or 7 to 0, can be fetched, an 

D 

^3 appropriate alpha value for most accurately controlling the 

degree of de focusing near the focus of the virtual camera cannot 
N be provided. 

Q1 For example, it is now assumed that if bits 13 to 12 in 

rij 

15 the Z value are fetched as 22 -value, the effective number of 

5 

H partitions (or the number of threshold values in the Z value) 

C3 

i-M can be stepped into 256. In such a case, if only bits 23 to 16 

;£j or 15 to 8 in the z value can be fetched, the effective number 

M* of partitions in the alpha value will be stepped into only 16 , 



20 leading to reduction of the image <iuality. 

On the contrary, if the technique of Fig. 17 is used, any 
bits I to J in the 2 value can be fetched as Z2 -value even though 
only 8 bits in the Z value within a predetermined range can be 
fetched as described above. Thus, the threshold values of the 

25 Z value for partitioning the alpha value can optimally be set 
depending on the range of near- clipping or the focus position 
of the virtual camera and an image with its improved quality 
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can be generated . 

Figs- 18, 19 and 2 OA snows example© of luti, WT2 and LUT3 . 
Fig. 2 OB shows a curve of transformation property in the LUT3 
for transforming Z2 -value into alpha value. 

As shown in Fig. 18, the l,UTl is ueed to shift bits 15 
to 6 (or M to U) of the Z value inputted as index numbers rightward 
by four bits. For example, OxlO and 0x50 (hexadecimal notation) 
may be transformed into 0x01 and 0x02, respectively. 

As shown in Pig. 19,. the IAJT2 is used to shift bits 23 
to 16 (or K to L) of the 2 value inputted as index numbers leftward 
by four bits. For example, 0x01 and 0X02 may be transformed into 
0x10 and 0x20, respectively. 

If the inputted Z value is larger than OxOF, the output 
of the 1jOT2 is clamped at 0xF0, as shown at Ql in Fig. 19. 

An example In which the Z value is clamped is shown in 
Fig* 21, Referring to Fig. 21, when bit 20 (or bit other than 
bits I to J) becomes one (1), the output of the I#UT2 is clamped 
at 0xF0. Thus, Z2 -value becomes OxFl. 

For example, if bits 19 to 12 in the Z value are directly 
fetched without clamping the output of the LUT2 , the 22 -value 
will be 0xll r notwithstanding the bit 20 is one (1) . This raises 
a problem in that the depth of field will wrongly be set. 

The clamping of the LUT2 output can prevent such a problem 
and properly set the depth of field. 

Moreover, the clamping of the LUT2 output will not provide 
any unnatural image since the degree of defocuaing for the 
near- clipped object OBI or the object OB2 located near the 



*. screen SC is only set maximum, as will be apparent from Pig. 
16. 

2 ♦ 6 Generation of def ocused image 
5 This embodiment effectively uses the bilinear filtering 

type (or texel interpolation type) texture mapping to generate 
tne def ocused image (Fig, 11B) to be blended with the original 
image (Pig* 11A) . 

There may be produced a positional deviation between a 
10 pixel and a texel in the texture mapping. 

a 

In such a case, the point sampling type texture mapping 
jj ■ renders the color CP (which is, in a broad sense, image 

information) at a pixel P (ox sampling point) the color CA at 

m 

0 3 | a texel TA nearest the point P, as shown in Fig. 22* 

! ^ 15 on the other hand, the bilinear filtering type texture 

a 

M mapping provides the color CP of the point P which are 

□ 

^ interpolated by the colors CA, CB, CC and CD of texels TA, TB, 

g'T TC and TD surrounding the point P . 

^ More particularly, coordinate ratio in X-axis direction 

20 — 0 (OS |5 ^ 1) . and coordinate ratio in Y-axis direction 

T:1"T (0 ^ T 2£ 1) are determined based on the coordinates 
of TA to TD and P. 

In this case, the color CP of the point P (or the output 
color in the bilinear filtering) may be represented by the 
25 following formula: 

cp - (i-j8) x (i-r) x ca+ j9x(i-r) x cb 



42 



+ (1-^) X7XCCH-/3X7XCD 



(8) 



This embodiment aims at the fact that the bilinear 
filtering type texture mapping automatically interpolates the 
5 colors, thereby generating a defocused image. 

More particularly, as shown at Rl in Fig. 23, an original 
image drawn in a frame buffer may be set as a texture, when this 
texture (or original image) is to be mapped on a virtual object 
through the bilinear filtering type texture mapping , texture 
10 coordinates given to the vertexes of the virtual object are 

P ' 

v!3 shifted (dislocated or moved) rightward and downward, for 

yj example,, by (0.5, 0,5) . In such a manner, a de focused image in 

which the colors of the pixels in the original image spread into 
the surrounding pixels can automatically be generated through 
^ 15 the biliaear filtering type interpolation. 



a 



If it is wanted to defocus the entire screen, the shape 
of a virtual object onto which the texture (or original image) 
is mapped is set to be equal to that of a screen (or a region 



m ■ 
•o ■ 

to be defocused) . For example, if the vertex coordinates" of the 



20 screen are (X, Y) « (0, 0), (640, 0), (640, 480), {0, 480), the 
vertex coordinates of the virtual object are also (X, Y) » (0, 
0), (€40, 0), (640, 480), (0, 480). 

In this case, if texture coordinates (u, v) given to the 
vertexes vxi, VX2, VX3 and VX4 of the virtual object are 

25 respectively set at (0, 0), (640, 0). (640, 480), (0, 480), the 
positions of the pixels in the screen will be identical with 
the positions of the texels in the texture. Therefore, the image 
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* will not be defocused. 

On the contrary, if texture coordinates (U, V) given to 
the vert exes VX1, VX2, VX3 and VX4 of the virtual object are 
respectively set at (0.5, 0.5), (640.5, 0.5), (640.5, 480-5), 
5 (0.5, 480,5) , the positions o£ the pixels in the screen will 
not be identical with the positions of the texels in the texture. 
Thus, the color interpolation will be executed to provide a 
defocused image through the bilinear filtering type 
interpolation. 

q 10 _ If it is wanted to defocus part of the screen, the shap'e 

of the virtual object may become equal to that of its defocused 
Lj region. 

ui 



As shown at R3 in Fig. 24, this embodiment a first 



G1 defocused image by setting the original image as a texture and 

B 15 shifting it in the rightward and downward direction (first shift 

\? direction) by 0.5 for performing the bilinear filtering type 

texture mapping. Next, as shown at R4 in Pig, 24, the first 

HI 

jpjj defocused image is then set as another texture and shifted by 

H* 0.5 in the leftward and upward direction (second' shift 

20 direction) . The bilinear filtering type texture mapping is then 
executed to generate a second defocused image. Alternatively, 
the aforementioned procedure (or shifting in the rightward and 
downward directions and in the leftward and upward directions) 
may be repeated several times. Thus, a more natural and more 
25 defocused image can be generated. 

The principle of generating the defocused image through 
the bilinear filtering type interpolation will be described 
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a 



below. 

For example, it is now assumed as shown in Fig. 2 5A that 
the bilinear filtering type texture mapping is carried out after 
the texture coordinates are shifted by 0.5 texels in the 
riglitward and downward direction. In this case, g - T - 1/2 
in. the above formula (8) . Therefore, if the colors in texels 
T44, T45, T54 and T55 are respectively made C44, C45, CS4 and 
C55. the color CP44 of a pixel P44 may be represented by the 
following formula: 



CP44 ~ <C44 + C45 + C54 + C55)/4 (9) 



10 

□ 

SJ As will be apparent from the foregoing, the color C44 of 



the texel T44 (which corresponds to the original color Of the 
15 pixel P44 in the original image before transformation) will 

a 

^-v 6pread into the surrounding pixels P33, P34, P43 an<3 P44 by each 

, 1/4 through the transformation shown in Fig. 25A. 

U1 Thereafter, as shown in Fig. 25B r the image obtained in 



Fig- 25A is set as a texture* the coordinates of which are then 
20 shifted by 0.5 in the leftward and upward direction for 
performing the bilinear filtering type texture mapping. In this 
case, the pixels P33, P34, P43 and ?44 in Fig. 25Awill correspond 
to the texels T33. T34, T43 and T44 in Fig. 25B. The color C44 
spread into the P33, P34, P43 and P44 {T33, T34, T43 and *44) 
25 by each 1/4 in Fig. 25A is then magnified further 1/4 and will 
spread into the four surrounding pixels. Eventually, the 
original color C44 of T44 will spread into the surrounding area 
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* by X/16 - 1/4 X 1/4. 

Thus, the color C44 (which corresponds to the original 
color of the pixel P44 in t*ie original image drawn in the frame 
buffer) will spread into the pixels P33, P34 and P35 

5 respectively by 1/16, 2/16 and 1/16 through the transformations 
of Figs. 25a and 25B. Furthermore, the color C44 will spread 
into the pixels P43, P44 and P45 respectively by 2/16, 4/16 and 
2/16 and into the pixels P53, P54 and P55 respectively by 1/16, 
2/16 and 1/16. 

10 As a result, such a plane filter as shown in Fig. 26A will 

U3 be applied to the original image through the transformations 

yj of Figs. 25A and 25B. Such a plane filter can uniformly spread 

V J 

; 2 the color of each pixel in the original image into the 

Ul 

01 surrounding area. This can generate an ideal defocused image 

15 of the original image. 

e ■ 

H If the set of transformations in Figs. 25A and 2SB are 

P 

repeated two times, such a plane filter as shown in Fig. 26b 

in 
P 

H* generate a more ideal defocused image than that of Fig. 26A. 



will be applied to the original image. Such a plane filter can 



20 

3. Detailed processing in the embodiment 

The details of the processing according to the embodiment 
of the present invention will be described in connection with 
flowcharts of Pigs. 27 and 28. 
25 First of all, an original image (or perspective - 

transformed image) is drawn in a frame buffer (step SI) . At this 
time, 2 -value for each pixel will be written into a Z buffer. 
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*- LDTl (Fig. 18) for transforming the bits 15 to 8 of the 

Z-value in the z buffer, hUT2 (Pig. 19) for transforming the 
bits 23 to 16 and LUT3 (Fig. 20A) for transforming the Z -value 
of 8 -bit form into alpha values (A values) are then transferred 
5 to VRAM (step S2) . 

Next, the bits 15 to 8 of the z-value is set as an index 
number in LUT1 which is in turn used to perform the texture 
mapping on a virtual polygon. This virtual polygon is then drawn 
in an additional buffer (step S3) . 
10 Next, the bits 23 to 16 of the Z-value is set as an index 

number in which is in turn used to make the texture mapping 

hj . on a virtual polygon. This virtual polygon is then drawn in an 

additional buffer (step S4) . At this time, the lower four bits 
(data effective bits) in the Z-value of 8 -bit form are masked 

ru 

s 15 not to be overwritten. 

' Next, the 8 -bit Z2 -value obtained at the step S4 is set 

N* . as an index number in LUT3 which is in turn used to make the 

^ texture mapping on a virtual polygon. This virtual polygon is 

■ drawn in the frame buffer (alpha plane) (step S5) . 

20 Next, the original image drawn in the work buffer at the 

step SI is mapped on a virtual polygon through the bilinear 
filtering mode while sifting the texture coordinates (U # V) by 
(0*5, 0.5). This virtual polygon is drawn in an additional 
buffer (step S6) . 
25 Next, the image drawn in the additional buffer at the step 

S€ is mapped on a virtual polygon through the bilinear filtering 
mode while sifting the texture coordinates (U, V) by (-0.5, 
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-0.5) . This virtual polygon is drawn in the frame buffer (step 
S7) . At this time, the alpha blending is carried out by using 
the alpha value drawn in the frame buffer at the step S5 to blend 
the original image with its defocused image - 

In such a manner, a so-called depth of field can be 
represented. 

4 . Hardware configuration 

Hardware configuration which can realize this embodiment 
is shown in Fig. 29. 

A main processor 900 operates to execute various types 
of processing such as game processing, image processing, sound 
processing and other processing according to a program stored 
in a CD (information storage medium) 982, a program transferred 
through a communication interface 99 0 or a program stored in 
a ROM (information storage medium) 95 0* 

h coprocessor 902 is to assist, the processing of the main 
processor 90 0 and has a product -sum operator and analog divider 
which can perform high- spaed parallel calculation to execute 
a matrix (or vector) calculation at high speed. If a physical 
simulation for causing an object to move or act (motion) 
requires the matrix calculation or the like, the program running 
on the main processor 900 instructs (or asks) that processing 
to the coprocessor 902. 

A geometry processor 904 performs geometry processing 
such as coordinate transformation, perspective transformation, 
light source calculation, curve formation or the like and has 
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a product -sum operator and analog divider which can perform 
high -speed parallel calculation to execute a matrix {or vector) 
calculation at high speed. For example, for the coordinate 
transformation, perspective transformation or light source 
calculation, the program running on the main processor 900 
instructs that processing to the geometry processor 504. 

A data expanding processor 906 performs a decoding 
process fox expanding compressed image and sound data or a 
process for accelerating the decoding process in the main 
processor 900. .In the opening , __intermi3 3ion, ending or game 
screen, thus, an MPEG compressed animation may be displayed. 
The image and sound data to be decoded may be stored in the 
storage devices including ROM 950 and CD 982 or may externally 
be transferred through the communication interface 390, 

A drawing processor 910 is to draw or render an object 
constructed by primitive surfaces such as polygons or curved 
faces at high speed. On drawing the object, the main processor 
900 uses a DMA controller 970 to deliver the object data to the 
drawing processor 910 and also to transfer a texture to a texture 
storage section 924, if necessary- Thus, the drawing processor 
910 draws the object in a frame buffer 952 at high speed while 
performing hidden -surf ace removal by the use of a Z-buffer or 
Che like, based on the object data and texture. The drawing 
processor 910 can also perform alpha blending (or translucency 
processing), depth cueing, mip-mapping, fogging, bilinear 
filtering, trilinear filtering, anti-aliasing, shading and so 
on. As the image for one frame has been written into the frame 



buffer 922, that image is displayed on a display 912. 

A sound processor 330 includes any multi-channel AD PCM 
sound source or the like to generate high-quality game sounds 
such as BGMs, sound effects and voices. The generated game 
sounds are outputted through -a speaker 932. 

The operational data from a game controller 942 , saved 
data from a memory card 944 and personal data may externally 
be transferred through a serial interface 94 0. 

ROM 95 0 has stored a system program and so on . For an arcade 
game system, the ROM 950 functions as an information storage 
medium in which various programs have been stored. The ROM 950 
may be replaced by any suitable hard disk. 

RAM 960 is used as a working area for various processors. 
DMA controller 97 0 is to control the DMA transfer between 
processors and memories (RAM, VRAM, ROM and so on) . 

CD controller 98 0 drives a CD (information storage 
medium) 982 in which the programs, image data or sound data have 
been stored and enables these programs and data to be accessed. 

The communication interface 99 0 performs data transfer 
between the game system and any external instrument through a 
network, in such a case, the network connec table with the 
communication interface 99 0 may take any of communication lines 
(analog phone line or ISDN) or high-speed serial bus. The use 
of the communication line enables the data transfer to be 
performed through the internet. If the high-speed serial 
interface bus is used, the data transfer may be carried out 
between the game system and any other game system. 



All the means of the present invention may be realized 
(executed) only through hardware or only through a program which 
has been stored in an information storage medium or which is 
distributed through the communication interface. 
Alternatively, they may be executed both through the hardware 
and program. 

if all the means of the present invention are executed 
both through the hardware and program, the information storage 
medium will have stored a program for realizing the respective 
means of the present invention through the hardware. More 
particularly, the aforementioned program instructs the 
respective processors 902, 904, 906, 910 and 930 which are 
hardware and also delivers the data to them, if necessary. Each 
of the processors 902. 904, 906, 910 and 930 will execute the 
corresponding one of the means of the present invention based 
on the instruction and delivered data. 

Fig. 3 OA shows an arcade game system to which this 
embodiment is applied. Players enjoy a game by controlling 
levers 1102 and buttons 1104 while viewing a game" image 
displayed on a display 1100 . A system board (circuit board) 1106 
included in the game system includes various processors and 
memories mounted thereon, information {program or data) for 
realizing all the means of the present invention has been stored 
in a memory 1108 on the system board 1106 , which is an information 
storage medium* Such information will be referred to "stored 
information* later. 

Fig. 3 0B shows a domestic game apparatus to which this 
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embodiment is applied. A player enjoys a game by manipulating 
game controllers 12 02 and 12 04 while viewing a game picture 
displayed on a display 1200. In such a case, the aforementioned 
stored information has been stored in DVD 12 06 and memory cards 
1208. 1209 which are detachable information storage media in 
the game system body. 

Fig. 30C shows an example wherein this embodiment is 
applied to a game system which includes a host machine 130 0 and 
terminals 1304-1 to 1304-n (game devices or portable 
telephones) connected to the host machine 1300 through a network 
{which is a small-scale network such as LAN or a global network 
such as INTERNET) 1302. in such a case, the above stored 
information has been stored in an information storage medium 
13 06 such as magnetic disk device, magnetic tape device, 
semiconductor memory or the like which can be controlled by the 
nost machine 1300, for example. If each of the terminals 1304-1 
to 1304-n generates game images and game sounds in a. stand- 
alone manner, the host machine 1300 delivers the game program 
and other data for generating game images and game sounds to 
the corresponding terminal 1304-1 to 1304-n. On the other hand, 
±f the game images and sounds cannot be generated by the 
terminals in the stand-alone manner, the host machine 1300 will 
generate the game images and sounds which are in turn 
transmitted to the terminals 1304-1 to 1304-n. 

In the arrangement of Fig. 30C, the means of the present 
invention may be decentralized into the host machine (or server) 
and terminals. The above information for realizing the 
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respective means of the present invention may be distributed 
and stored into the information storage media of the host 
machine (or server) and terminals. 

Each of the terminals connected to the network may be 
either of home or arcade type* When the arcade game systems are 
connected to the network* it is desirable that each of the arcade 
game systems includes a portable information storage device 
(memory card or portable game machine) which can not only 
transmit the information between the arcade game systems but 
also transmit the information between the arcade game systems 
and the domestic game systems. 

The present invention is not limited to the things 
described in connection with the above forms, but maybe carried 
out in any of various other forme . 

For example, part of tne structural requirements in any 
of claims having dependent claims of the invention can be 
omitted. Primary part of an independent claim of the invention 
can be made dependent on any other independent claim. 

This embodiment has been described as to the set alpha 
values which are used to perform alpha blending of the original 
image and its defocused image for implementing the 
representation of the depth of field. However, the image 
representation using the alpha values set by the technique of 
the present invention is not limited to such an image 
representation of the depth of field. For example, the set alpha 
values may be used to carry out alpha blending of the color of 
the original image and a given color (e.g,, background color 
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or target color) , to change the brightness or chroma in the 
original image, to perform alpha blending of the original itnage 
and o given other image, or to perform alpha blending of the 
original image with its transformed image. 

Although it is particularly desirable that the 
transformation of the depth value into the second depth value 
is realized through the technique of using the index color 
texture -mapping lookup table as described in connection with 
Fig. 17 # it may be realized by any other suitable technique. 

__ The technique of setting-the- alpha value depending on the 

second depth value may be any of various techniques such as the 
technique of using the index color texture -mapping lookup table 
as described in connection with Figs. 4 and 9 or the technique 
of sequentially drawing the virtual objects to update the alpha 
values in the pixels deeper or nearer from the virtual objects 
in the sequential manner as described in connection with Fig. 
13 . 

The fetching of any bits I to J in the depth value has 
been described in connection with Fig. 21. However, the 
technique of Fig* 21 may also broadly be applied to the fetching 
of any bits 1 to J in any image information other than the depth 
value (e.g. , information relating to color or alpha value, drawn 
in the drawing region) . 

The transformation property of the lookup table is not 
limited to those shown in Figs. 18, 19, 20A and 20B, but may 
be carried out in any of various other forms. 

It is particularly desirable that the defocused image to 
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*■ be blended with the original image is generated through the 
technics described in connection with Figs. 23 and 24. However, 
the present invention is not limited to such a technique. For 
example, the defocused image may generated by blending the 
5 orig-inal image with an image formed by shifting the original 
image or by blending the original image in the present frame 
with the original image in the previous frame. 

The generation of the defocused image through the texel 
interpolation is not limited to those described in connection 
10 with Figs. 23 to-26B. For example, -a region to be defocused that 
is smaller than the screen may be set. The original image on 
chat smaller region may only be defocused, rather than the 



SJi entire screen 



Although this embodiment has been described as the depth 



V* is value increased as the corresponding pixel is located nearer 

the viewpoint, the depth value may be increased as the 

H 

. - corresponding pixel is located farther apart from the 

h* 

Ul viewpoint . 

^ The present invention may similarly be applied to any of 

20 various other games such as fighting games, shooting games, 
robot combat games, sports games, competitive games, roll- 
playing games f music playing games, dancing games and so on. 

Furthermore , the present invention can be applied to 
various image generating systems such as arcade game systems, 
25 domestic game systems, large-scaled multi-player attraction 
systems, simulators, multimedia terminals, image generating 
systems, game image generating system boards and so on. 
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